Practical experimental certification of computational quantum gates via twirling 
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Due to the technical difficuUy of building large quantum computers, it is important to be able to estimate how 
faithful a given implementation is to an ideal quantum computer. The common approach of completely charac- 
terizing the computation process via quantum process tomography requires an exponential amount of resources, 
and thus is not practical even for relatively small devices. We solve this problem by demonstrating that twirling 
experiments previously used to characterize the average fidelity of quantum memories efficiently can be easily 
adapted to estimate the average fidelity of the experimental implementation of important quantum computation 
processes, such as unitaries in the Clifford group, in a practical and efficient manner with applicability in cur- 
rent quantum devices. Using this procedure, we demonstrate state-of-the-art coherent control of an ensemble 
of magnetic moments of nuclear spins in a single crystal solid by implementing the encoding operation for a 3 
qubit code with only a 1% degradation in average fidelity discounting preparation and measurement errors. We 
also highlight one of the advances that was instrumental in achieving such high fidelity control. 



Introduction - Due to the technical challenges of build- 
ing quantum computers, only small building blocks of such 
devices have been demonstrated so far in a number of differ- 
ent physical systems. In order to quantify how closely these 
demonstrations come to the desired ideal operations, the ex- 
periments are fully characterized via quantum process tomog- 
raphy (QPT) HI 21, and, often, the average fidelity HIl be- 
tween the experiment and the ideal operator is calculated from 
the description of the estimated process. The main drawback 
of this approach is that quantum process tomography fun- 
damentally requires an exponential number of experiments. 
Moreover, the classical post-processing of the data is non- 
trivial, as the raw experimental data does not lead to a physi- 
cal description, and approaches such as maximum likelihood 
or Bayesian estimation on an exponentially large parameter 
space are needed to find the most appropriate physical de- 
scription |5 1. Therefore approaches based on QPT to estimate 
the average fidelity are not practical, and cannot be reason- 
ably expected to be used even in systems that are only moder- 
ately larger than the current experimental state of the art. Here 
we solve this problem by showing that, for an important class 
of quantum operations, the average fidelity can be estimated 
efficiently, requiring a number of experiments which is inde- 
pendent of the system size. This new proposal is also practi- 
cal, and enables the demonstration of processes which would 
not have been possible due to the complexity of QPT. We use 
this protocol to demonstrate state-of-the-art coherent control 
of the magnetic moments of an ensemble of nuclear spins in 
a single crystal solid, and highlight one of the advances that 
was instrumental in achieving such high fidelity control. 

Twirling - It has been recently shown that if one wishes to 
compare an experimental implementation of a quantum pro- 
cess to the identity process {i.e. a process where the system 
state remains unchanged, such as in the case of ideal quantum 
memories), then it is possible to estimate the average fidelity 
via a technique known as twirling ||6 HT0I . with a number of 
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FIG. 1. The relationship between (a) comparing a physical process £ 
to the identity, and (c) comparing a physical process U — U o £ to a. 
unitary W can be seen by (b) the appropriate insertion of the identity 
o U. When U and all d are elements of the Clifford group, and 
Mj is a Pauli operator, f{Mj,Ci,U) isalsoaPauli operator. 



experiments which depends only on the desired accuracy of 
the estimate, not on the system size — moreover, these exper- 
iments are simple to implement, requiring only local opera- 
tions and measurements fS). The twirling procedure consists 
of applying a random unitary before the process to be char- 
acterized, followed by the inverse of this randomly chosen 
unitary. When these unitaries obey certain symmetry proper- 
ties, the resulting invariant information about the noise under 
this symmetry can be extracted by repeating the experiment 
with different random choices. For example, if the twirling 
gates are random permutations followed by tensor products of 
single-qubit Cliffords then information about the weights of 
the noise terms can be determined ||8|. The schematic for such 
an experiment is depicted in Fig. [TJa), where the process we 
would like to compare to the identity process, £, is conjugated 
with Ci, an appropriately chosen randomizing local operation, 
and Mj is the measurement of the parity of a subset of qubits 
in the computational basis. 

For more general processes, in order to compare a given 
process to a desired unitary evolution one could in princi- 
ple apply the physical process under consideration, and then 
apply the inverse of the unitary evolution we would like to 
compare it against, finally measuring the overlap between the 
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initial state and the resulting state for a set of initial states 
— this is, in essence, the definition of the average fidelity. 
The obstacle to implementing such a protocol is that often 
one is attempting to demonstrate or certify the implementa- 
tion of a unitary, and a noiseless implementation of its inverse 
cannot be assumed to be available. One way |l6l (TT] [T2]| to 
address this problem is to estimate the average fidelity over 
a set of quantum processes that form a group by considering 
random sequences of such processes chosen to result in the 
identity process — examples of such sets include the group 
of all unitary processes, as well as the Clifford group |13|. 
Such motion-reversal benchmarking schemes suffer from two 
shortcommings: they apply only to noise satisfying certain 
strength conditions | tl2] . and they only provide information 
about the average over a set of processes instead of specific in- 
formation about a particular process. While this information 
is useful, what is experimentally most useful is to diagnose 
coherent control implementation errors, which, in our expe- 
rience, are highly process-dependent. Therefore, it is critical 
for the experimentalist to be able to characterize a particular 
process. 

Certification procedure - The result we report here, which 
side-steps many of the shortcomings listed above, is that the 
average fidelity between any physical process on multiple 
qubits and any particular element of the Clifford group can be 
estimated efficiently by a simple modification to the twirling 
protocol, leading to the same favourable scaling as experi- 
ments which compare a physical process to the identity. If we 
define U to be the desired element of the Clifford group, then 
the noisy implementation U can be thought of as some noisy 
process £ followed by the application of U, i.e. U = U o £. 
Unitaries in the Clifford group include operations needed to 
encode and decode quantum information to protect it from 
noise 1 14| — in current approaches to fault-tolerance these op- 
erations comprise the vast majority of (if not all) operations. 
Clifford group operations can also be used to achieve universal 
fault-tolerant quantum computation with the aid of especially 
prepared resource states ifTSl ITSl . so these operations are of 
great importance and utility for quantum computation. 

In order to see why the average fidelity can be estimated ef- 
ficiently for these operations, consider Fig.[TJb), which modi- 
fies the original twirling protocol lH by inserting the identity 
process — in this case written as o U. One can in principle 
combine all processes after the first application oiU in (b) into 
a new measurement. For a general unitary process this new 
measurement will be as hard to implement as performing the 
process U itself. However, if U is an element of the Clifford 
group [161, this results in the measurement of the parity of a 
different set of qubits in a different local basis (or equivalently, 
the measurement of a different Pauli operator 1 13 1) which can 
be precomputed efficiently given U, the local randomizing 
Clifford operation Ci, and the original measurement Mj, as 
depicted in Fig.[l}c), where f{AIj,Ci,U) = U{C^MjCl). In 
essence, the protocol in Fig. [TJc) is the experiment, but the 
data is analyzed according to Fig. [TJa) as described in |[8]|3, 
which separates the noise £ from the unitary U. 



As the parity measurement is equivalent to local measure- 
ment followed by simple data post-processing, and the initial 
states required are product states locally equivalent to the all- 
zeros state, it is important that precise local operation be avail- 
able. In other words, the problem of implementing the inverse 
of a multibody Clifford unitary U can be translated into the 
problem of implementing classical data processing and local 
(single-body) quantum operations reliably. These operations 
are often readily available at high fidelities, as randomizing 
benchmarking results have demonstrated flTl ITtI ITSl . Thus 
the average fidelity of any implementation of a Chfford group 
operation can be estimated using a number of experiments 
that depends only on the desired accuracy, as is the case for 
twirling experiments with quantum memories |8|. 

Due to this connection to twirling protocols, our proposal 
also enables the estimation of other parameters beyond the 
gate fidelity, such as the probability of errors of a given 
weight. Recent proposals for Monte Carlo estimation of state 
and gate fidelity have the same scaling as the protocol we de- 
scribe here (in the case of Clifford gates) lfT9ll20l . However, 
the probability of errors of a given weight are not natural pa- 
rameters to be considered in the Monte Carlo sampling pro- 
posals, demonstrating the advantage of considering twirling 
protocols in this context. The simplicity of the experiments 
also shows that our proposal is of practical significance in 
the benchmarking of these important operations. Moreover, 
because the estimation of the average fidelity in the twirling 
protocol corresponds to the estimation of the probability of 
no errors having occurred (a single parameter that is accessi- 
ble with an accuracy that does not depend on the the number 
of qubits 1 8 1), Bayesian estimation of such a probability is 
straightforward, as is the calculation of uncertainties associ- 
ated with these estimates. 

Experiment - A common task for an experimentalist is 
to optimize and tweak the performance of a particular gate 
on the system. The experimenter has many potential knobs to 
adjust and he/she needs a reliable robust method for certifying 
whether any changes actually improved the performance. A 
trivial example is calibrating the power of a pulse but here 
we demonstrate how we can easily quantify the improvement 
from more subtle and sophisticated control improvements. 

Building on the success of liquid-state NMR as a test bed 
of QIP ideas. Solid-state NMR systems offer ||2T] |22l intrin- 
sically larger couplings, longer coherence times, the ability 
to pump entropy out of the system of interest into a spin 
bath 1231 [24 1 and the potential for much higher initial polar- 
izations. This comes at the cost of a more complicated inter- 
nal Hamiltonian, which makes the system harder to control in 
practice. 

Methods inspired by optimal control theory have been suc- 
cessful in aiding pulse design for small systems. However, 
for these pulses to achieve the designed fidelity, it is impor- 
tant that the implemented control fields at the sample match 
the designed ones. That is to say, any systematic deviations 
from the designed pulses, due to the finite bandwidth of the 
resonant probe circuit or the non-linearities in the pulse gen- 
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FIG. 2. Portion of a typical pulse shape showing (in solid blue) the 
designed target shape, (in red dots) the initial attempt at implement- 
ing the pulse including systematic imperfections due to nonlineari- 
ties in pulse generation and amplification as well as finite bandwidth 
effects from the probe's resonant circuit, and (in green circles) the 
corrected shape after the feedback protocol. Full power corresponds 
to nutation frequency of SOkHz. 

erators and amplifiers, need to be accounted for or rectified. 
To this end, a feedback system can be employed to correct 
for these systematic imperfections 1251 . We use an antenna 
to measure the fields in the vicinity of the sample, then this 
data is fed back for comparison with the target pulse, and a 
new pulse form that attempts to compensate for the imperfec- 
tions is computed and sent back to the signal generation unit. 
This loop is repeated a number of times to reach a satisfactory 
pulse form ll26l l27l . Fig. [2] shows a typical example of the 
measured pulse forms of the initial and corrected attempts to 
match a target pulse shape. The development of this feedback 
pulse rectification protocol has led to a great improvement in 
the fidelity of coherent control of nuclear spins in the solid 
state - the certification scheme is used herein to demonstrate 
and quantify the typical improvement in fidelity resulting from 
using the feedback system. 

The specific computational register under investigation is 
an ensemble of molecular nuclear spins in a macroscopic 
single crystal of Malonic Acid (C3H4O4). A small fraction 
3%) of the molecules are triply labeled with (spin-^) ^■^C 
to form an ensemble of 3-qubit processor molecules, spatially 
buffered from one another by molecules of the same com- 
pound but with natural abundance (~ 1%) carbon nuclei. Dur- 
ing computation, the processors are decoupled from the 100% 
abundant spin-^ protons in the crystal by applying a decou- 
pling pulse sequence to the protons. 

The experiments were performed at room temperature in a 
static field of 7. IT using a puipose-built NMR probe. Shown 
in Fig. [3] is a proton-decoupled ^''C spectrum, following 
polarization-transfer from the abundant protons, for the par- 
ticular orientation of the crystal used in this experiment. A 
precise spectral fit gives the Hamiltonian parameters (listed 
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FIG. 3. Malonic acid (C3H4O4) molecule and Hamiltonian parame- 
ters (all values in kHz). Elements along the diagonal represent chem- 
ical shifts, Ui, with respect to the transmitter frequency (with the 
Hamiltonian J]]; nuiZi). Above the diagonal are dipolar coupling 
constants, X]i<j ''^Dij{2 ZiZj — XiXj — YiYj), and below the di- 
agonal are J coupling constants, X]i<j ^Ji-.A^i^i +XiXj+YiYj). 
An accurate natural Hamiltonian is necessary for high fidelity con- 
trol and is obtained from precise spectral fitting of (also shown) a 
proton-decoupled ^^C spectrum following polarization-transfer from 
the abundant protons. The central peak in each quintuplet is due to 
natural abundance ^"'C nuclei present in the crystal at ~ 1%. (for 
more details see L22ii24J and references therein.) 

in the inset table in Fig. |3]l, as well as the free-induction de- 
phasing times, T2, for the various transitions; these average 
at ~' 2ms. The dominant contribution to Tj* is Zeeman-shift 
dispersion, which is largely refocused by the control pulses, 
leading to effective dephasing times much larger than [22|. 
The carbon control pulses are numerically optimized to im- 
plement the required unitary gates using the Gradient Ascent 
Pulse Engineering (GRAPE) |28| algorithm, and are typically 
designed [29] to have an average Hilbert-Schmidt fidelity of 
99.8% over appropriate distributions of Zeeman-shift disper- 
sion and control-fields inhomogeneity. 

Preparation and measurement - The first step in the ini- 
tial preparation procedure for all experiments described below 
is a selective polarization transfer from one of the methylene 
protons (H„ij) to the methylene carbon (C,„). This is real- 
ized using a short [30 1 Haitman-Hahn cross-polarization se- 
quence [31 1 after tipping the proton polarization to the trans- 
verse plane, and is sufficient because the coupling strength 
between these two nuclei is more than an order of magnitude 
larger than any other coupling. The state of the three car- 
bon nuclei after this polarization can be described as pi — 
/■^■^ + allX, where a quantifies the amount of polarization 
transferred from the proton, and is on the order of ~ 10^^ for 
protons in 7. IT at room temperature. A free induction decay 
is collected for this initial state to establish a reference for a, 
against which all subsequent experiments are compared. Sim- 
ple coherence-transfer pulses can then be used to prepare all 
states of the form = /"^^ + aX'^'^ , and their per- 
mutations over 3 qubits, for w = 1, 2, 3. From these states, 
pulses realizing single qubit | rotations are all that is required 
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FIG. 4. Randomized benchmarking of single qubit ^ rotations re- 
quired for state preparation and measurement - shown is the average 
fidelity decay of randomized sequences of ^ pulses on each of the 
three qubits. Each data point is the average fidelity of 24 sequences. 
Fitting the data to f 121 log(-F' ~ ^) ~ log Aq + m logp , we extract 
an average error per gate of 1.6±0.4 x 10~^ for Ci (blue diamonds), 
3.8 ± 0.7 X 10"^ for C2 (red squares), and 4.4 ± 0.6 x 10"^ for C3 
(Cm) (green circles). 



for preparing a state with non-zero projection on any arbitrary 
3-qubit Pauli operator The same set of pulses are sufficient 
to transform any output state into an observable in an NMR 
experiment. 

These single-qubit | rotations can be realized with very 
high fidelity, which we now demonstrate using single qubit 
randomized benchmarking |12| on each of the qubits - the 
average fidelity of randomized sequences of pulses that com- 
pose to the Identity is measured for varying sequence lengths, 
and assuming that the implementation errors do not depend 
on which gate is being applied, the average fidelity decay is fit 
to lfT2]l : F = Aop™+i?o , where m is the sequence length, Aq 
and Bq encompass initialization and measurement errors, and 
p is a parameter related to the average error per gate, r — . 
Assuming the gate errors are unital, we set Bq = ^. In Fig.|4] 
the average fidelity of 24 sequences each for up to 96 pulses 
per sequence is plotted, and the average error per single qubit 
I pulse is estimated to be less than 0.5%. These 400/is pulses 
are designed to selectively rotate the target qubit while not af- 
fecting the others. As seen in Fig. |3] the Ci transitions are 
well separated in frequency from the other transitions, which 
explains the ability to selectively rotate that spin with better 
fidelity for pulses with the same length. 

Furthermore, to get an estimate of the average combined 
fidelity of the state preparation and measurement processes, 
we certify the do nothing operation against the target Identity 
evolution. The results are summarized in Fig. |5^. 

Certifying the 3-qubit encoding - Next, we choose to 
certify the (1.5 ms) pulse 1321 designed to perform the en- 
coding operation of the phase variant of the 3 qubit quan- 
tum error correcting code against the ideal gate |33|, which 
is a 3-qubit Clifford gate that decomposes to two CNOTs fol- 
lowed by transversal single-qubit Hadamards. As shown in 
Fig. |5] the average fidelity of the implemented pulse, before 
and after rectification — including preparation and measure- 



ment errors — is estimated to be 86.3% and 97.3%, respec- 
tively. Under an assumption that the errors from preparation 
and measurement are factorable, we estimate the average fi- 
delity of the rectified implementation to be 99%. 

Discussion - We have shown how it is possible to certify 
individual Clifford group operations efficiently using a modi- 
fied twirling protocol. As an illustrative example, we demon- 
strated the certification of the encoding operation for a 3 qubit 
error correction code, and the improvements on the perfor- 
mance of this operation via feedback of measurements of the 
control field at the NMR sample. Owing to the practicality 
and simplicity of the protocol, we have adopted it as a method 
of performing single parameter calibration of shaped pulses. 
This scheme can be extended to an in situ pulse design pro- 
tocol, in which individual parameters can be optimized itera- 
tively without assumptions about experimental imperfections. 
While it is essential to have access to reliable single-qubit op- 
erations before using the twirl protocol, the reliability of such 
operations can be certified via randomized benchmarking, as 
we have demonstrated. 

Appendix A: Experimental procedure with example 

In this section, we describe in some detail the proposed pro- 
tocol for estimating the average fidelity of a noisy implemen- 
tation U to an ideal n-qubit Clifford gate U. For illustrative 
purposes, we use the encoding circuit (34] of the five-qubit 
code [351 (shown in Fig. [6]) as a running example of the uni- 
tary process to be certified. As mentioned in the main text, 
this protocol can be viewed as a variation on a local-Cliffords- 
and-permutations twirling scheme described in ref. [8 |, and 
detailed in ref. ||9l as the parity monitoring protocol. 

In order to estimate the average fidelity between a physical 
implementation U and the ideal encoding circuit U, one can 
use the following procedure. 

1. Offline, for each w £ 1, • • • ,n: 

(a) Choose an operator Mk with weight w from the 
Pauli group on n-qubits. The overall sign of the 
Pauli operator should also be chosen uniformly at 
random. This is a tensor product of n single-qubit 
Pauli operators, where n — w of them are the iden- 
tity. This step amounts to picking a random string 
of 2ti; + 1 bits, and choosing w qubits at random 
on which to act with the non-identity Paulis. 

(b) For the running example, one such choice for, say, 
w = 3 would heMi=i(E)Y(g)i(E)X(E)Z. 

(c) Repeat this procedure fc^, = 0(l/e^) times in or- 
der to achieve a final accuracy of e l|8l . 

2. In the laboratory: 

(a) For each choice of Mk, prepare a state pk such 
that 

rk:={Mk)p,=tTpkMk^O- (1) 
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FIG. 5. Summary of the experimental parameters and results for the three sets of certification experiments - the Target column shows the 
quantum circuit representation of the ideal process; the Experiment column represents the experimental setup to certify the corresponding 
implementation, including state preparation and measurement using local readout pulses as described in the text; and Au, are, respectively, 
the number of performed experiments, and the average surviving polarization, partitioned by the Pauli-weight, u), of the input preparation 
(for more details, see Appendix A.) Shown also are the Bayesian estimated probability density functions for the probability of no error in the 
experimental implementation of the target gate, as well as the estimated average fidelity. The three sets of experiments are (a) State preparation 
and measurement compared to the Identity operation - this can be thought of as a calibration for the certification procedure; (b) the target is 
the encoding operation for the 3-qubit phase quantum error correcting code, and the experimental implementation is a numerically designed 
pulse using GRAPE; and (c) is the same as (b) but the pulse is corrected for implementation errors using the feedback procedure described in 
the text. 
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FIG. 6. Encoding network for the [[5,1,3]] stabilizer code f341. 



This, for example, can always be achieved by 
applying local Cliffords to the state jO)**". For 
Ml = / (g) F (g) / (g) X (g) Z, one choice of local 
operations which achieves this is Ci = 1(E) PH g) 
/g)7Jg)/, where i? = ^ ( } _\ ) and P = ( J « ), 
resulting in ri = 1. 



(b) Apply the noisy implementation U to the prepared 
state pk 



(c) Measure the expectation value 

= tr\cj£{C,\0}{0\'^"Cj)QMk . 



(2) 



If, for example, one had access only to pro- 
jective measurements in the Pauli Z eigenba- 
sis on the individual qubits, a measurement of 
f{Mk,Ci,U) can be accomplished by a basis 
change which is a tensor product of single-qubit 
Clifford transformations. For the running exam- 
ple, f{Mi,Ci,U) = Z®Zg)/g)yg)l, so 
that the transformation needed to change Pauli 
Z measurements into this observable would be 

c[ = i(g)i(g)i(g)pH(E)H. 

3. The average fidelity should be estimated as follows: 

(a) For each weight w, is the average of the ratio 
tk/rk for all of weight w (Aq is taken to be 1). 

(b) Pr(no error) is the inner product of A^, and the 
first row of fi^^, which is a matrix described in 
refs. 18] 121. This results in 



Pr(no error) = 



A„ 



(3) 



(c) The average fidelity F between U and U is finally 
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given by 

— _ 2" Pr(no error) + 1 
~ 2" + 1 



Appendix B: Software 

A simple script which automates the computation of 
the transformed Pauh operators given some Clifford opera- 
tion can be found at http : / / github . com/marcusps/ 
IXransPaulil 
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